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Abstract 

Interest in strengthening the impact and value of education research has 
been growing around the world. Here I outline a view of the nature of 
“impact” and point to instances where research has had a positive impact 
in education, but always within a larger social and political framework. A 
three element “model” of research impact is developed and used as the 
basis to assess current situations and to suggest steps that could be taken to 
support a fuller contribution to education and learning from research. 


Growing Interest in Research 

Interest in strengthening the impact and value of education research has been 
growing around the world, among governments and funders as well as scholars. The issue 
of research impact has also been a prominent theme in Educational Researcher (e.g. Berliner, 
2002, Feuer, Towne & Shavelson, 2002). This paper outlines a view of the nature of 
“impact,” examines initiatives in this area in several countries, and suggests steps that could 
be taken to support a fuller contribution to education and learning from research. However 
it should be clear from the outset that the contribution of research is always mediated 
through broader social and political processes with all their attendant limitations. Nor do I 
address in this paper some very important related questions, such as what issues are most 
important to study, or who should do research and what training researchers should receive. 
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The term “research” is itself contested and can cover quite a wide range of activities, 
from carefully designed studies by independent, university-based researchers to analysis of 
data for particular administrative or political purposes to arguments for specific policy 
positions that may be more or less well grounded in evidence. Any consensus that might 
once have existed about what counts as research has vanished in education, with highly 
contentious arguments about the relative merits of research based on methods from the 
natural sciences vs modes closer to the humanities. I am not in this paper endorsing or 
promoting a particular view about what constitutes “good” research in education; many 
different forms of research can have an impact in the senses defined in this paper. 

The debate about the value of education research is a long-standing one but appears 
to have been growing in intensity in recent years. Increasing interest in research is driven by 
a more educated population and a growing awareness of the need to understand more fully 
the complex problems confronting us (Homer-Dixon, 2000). Research conjures up images 
of science and of objectivity. Governments want to claim that their policies are supported by 
evidence. Increasing requirements for accountability for public spending also put greater 
emphasis on evidence' 1 The media give more mention to research even if the reporting may 
not always be as careful as might be wished. The phenomenal growth of the internet and its 
growing use by a wide range of people as a source of information is another illustration of 
this interest. 

Education, though these larger trends do apply to it, also has some particular 
characteristics that affect the role that research can play. It is a value-laden activity, 
inextricably connected to our broadest aspirations for society. It embodies a wide range of 
purposes that are not always mutually consistent. People may agree on educational goals 
only at the most general level, with many conflicts not only about goals but about the best 
means of carrying them out. Many disagreements about education research are actually 
differences over the substance of education policy. Education also has less history of basing 
policy and practice on research than do some other fields. The fact that everyone has gone 
to school, the relatively low status of teaching as an occupation, the recent arrival of 
education as a field of study in the university, and the lack of a clear disciplinary base, or 
rather the multiple disciplinary contributions to the field (Lagemann, 2000) are all factors. 

What is impact? 

Although research impact is very topical, “There is a surprisingly small literature on 
the impact of educational research on policy and practice” including an “underdeveloped 
language in which to explore the topic” (National Education Research Fomm, 2000, 1). In 
this article I use a variety of terms such as “use,” “impact” and “value” to stand for the 
relationship and contribution of research to other spheres of life. None of these terms is 
entirely satisfactory, but we lack a better vocabulary. 

Impact occurs when research, in any of its multiple forms, makes a difference to 
subsequent actions that people take or refrain from taking. This is a simple statement but a 
full discussion of its meaning would take this narrative off course (see Lavis et al. 2002, for a 
discussion in the context of health research). Research may be used by people in their public 
or private lives, or by organizations of all kinds. People may or may not be aware that their 
ideas and actions have been shaped by research. 


1 I am indebted to Jane Kenway, Monash University, Australia for this point. 
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Most importantly, research is only one influence on human action; and, as described 
more fully later, its impact is always mediated by larger social and political processes. Thus 
research impact is not always a good thing (Levacic & Glatter, 2001, Willinsky, 2000). 
Research has been used to support positions that were later shown to be wrong or, even 
worse, are now considered morally repugnant, such as the supposed inferiority of some 
groups of people. In some ways it might be more appropriate to use the more neutral term 
consequences of research rather than impact. 1 

Why so much criticism of education research? 

Reports or position papers bemoaning the lack of value of research in education 
have appeared in a number of countries over the years, with a new spate more recently. The 
complaints are familiar ones - research in education is of poor quality, it does not address 
the issues people in the field care about, it is equivocal in its findings, it does not provide 
sufficient guidance to policy or practice, it is not timely. 

These critiques are being advanced in many countries. In Britain, a very lively debate 
was provoked a few years ago by a lecture by David Hargreaves (1996) comparing education 
research and medical research to the detriment of the former, leading to a government 
commission on the subject (Hillage et al., 1998). France (Prost, 2001) and Australia (McGaw 
et al., 1992) have had similar public reviews. 

In the United States, there have also been substantial attacks on the value of 
education research (Coalition for Evidence-Based Policy, 2002; Gardner, 2002), with the 
suggestion that the research is of poor quality and does not affect policy or practice. A 
website closely linked to the U. S. Department of Education (www.w-w-c.org/ about.html) 
notes: “Our nation’s failure to improve its schools is due in part to insufficient and flawed 
education research. Even when rigorous research exists, solid evidence rarely makes it into 
the hands of practitioners, policy-makers and others who need it to guide their decisions.” 

The criticisms seem stronger than is warranted by the evidence on the impact of 
research in education. There are many instances where research has played an important 
role in shaping policy and practice. Consider our growing knowledge about the importance 
of the development of very young children (e.g. Barnett, 1996; Haveman & Wolfe, 1994). In 
the United States, this evidence has played an important role in creating and sustaining 
programs such as Head Start and Early Start. In Canada, it was instrumental in a 1999 
federal-provincial agreement to expand dramatically public investment in early childhood 
development. In England, it has also been important in shaping the policy agenda of the 
government in a variety of ways. 

Consider a second example: research on school improvement (e.g Fullan, 2001; 
Hopkins, 2001). The practice of school reform, especially at the local level, increasingly 
reflects our understanding that meaningful reform must build educators’ capacity and pay 
attention to the whole school context. This is a dramatic change from the top-down, 
teacher-proof strategies of the 1960s. It would be easy to cite other examples, such as 
growing attention to working with parents and families or the move of children with 
disabilities from segregated settings into regular schools and programs. Furthermore, studies 
in the United States (Biddle & Saha, 2002) and in Australia (DETYA 2000) found that very 


2 1 am indebted to Sally Power, Cardiff University, for this point. 
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large majorities of educators and policy-makers thought that their work was actively 
informed by research, though largely in a variety of indirect ways. 

If research in education has in fact had a significant impact, why is there so much 
criticism of it? One reason is that there are many important questions of education policy 
and practice where research provides little guidance. Much of education is concerned with 
producing significant and lasting change in how people think or behave, yet on the whole we 
do not yet know very much about how to do this, either in schools or in other settings. 
Policy-makers are often faced with difficult alternative choices around how to use resources; 
again, research often has little to say about what choices are best. There are good reasons, 
conceptual and practical, why this is so - to mention two, the issues are often very complex 
and the total education research effort is comparatively small - but the lack of clear direction 
is understandably frustrating for users. People also may have strong a priori views about 
how education ought to be conducted, and may become frustrated when research does not 
support those views. Much of the debate about research in the United States is more about 
substantive positions on issues than it is about research methods. 

A second basis for criticism lies in the frequent assumption that there should be a 
direct line between research and subsequent policy and practice such that research findings 
point unambiguously to what governments, educators or learners should do. This line of 
thinking appears to lie behind some of the recent direction of the U. S. government in 
education. Practitioners are also often looking for immediate, clear and unambiguous 
direction as to what to do. 

The difficulties with a direct transmission view of research impact have been well 
described elsewhere (e.g. Stone, 1997; Weiss, 1979). They range from utilitarian concerns to 
philosophical objections. Knowledge of what to do does not translate directly into policy or 
practice because these latter are shaped as much or more by social, cultural and political 
considerations as they are by particular kinds of formal knowledge (Lindblom, 1990; Lavis et 
al., 2002). Policy makers may face political impediments that make it impossible or 
undesirable to act. Practitioners may be deeply enmeshed in practices and beliefs that are 
highly resistant to change. In health we are learning how hard it is to change physician 
practices even when evidence seems compelling; in education we are already well aware of 
how hard it is to change teaching practices on a large scale (Fullan, 2001). 

On the conceptual side, a considerable body of work has shown how knowledge 
about human behaviour is in principle different from knowledge of the inanimate world, so 
that the results of research cannot be assumed to be universal and generalizable as are, say, 
the laws of chemistry (Bernstein, 1976). This is primarily because people are intentional 
actors who can and do change their actions as their understanding of the situation changes. 
(For a wonderful example of this point in the context of research itself, see Orne, 1962). As 
a result few if any findings about human behaviour will apply under all conditions, nor is it 
easy, if even possible, to specify the precise conditions under which a given generalization 
will hold. 

These complexities are a main reason that much research in social sciences produces 
probabilities — the chance that something might happen given certain other conditions — 
rather than certainties (Willinsky, 2000). However assessing probabilities is a tricky business 
and often leads to conflict over what research results imply for subsequent action (e.g. 

Powell & Leiss, 1997). Social science knowledge tends to be tentative and contextual, 
whereas users want certainty. 
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These are real and powerful limitations on the impact of research. They draw our 
attention to the importance of power relationships, political dynamics, human biases and all 
the other factors that shape what people do (Dror, 1986). It is not reasonable to think that 
research will be the primary driver of action except in very rare circumstances. It does not 
follow, however, that we must despair about the impact of research, as our earlier examples 
show. These stories of impact provide a better idea of how and when research does make a 
positive contribution. 


How impact happens 

A number of scholars have shown that where research has impact, it occurs over 
extended periods of time (Weiss, 1979; Willinsky, 2000). As is clear from the earlier 
examples in education or others such as the dangers of smoking or the virtues of exercise, it 
may take decades for research findings to have real impact. 

Nor does this impact usually occur through direct contact between a researcher and a 
decision-maker. Instead, users typically learn about research through various third party 
mechanisms as part of larger social and political processes. The media, both mass and 
professional, play a key role in bringing ideas to people’s attention. People often rely on 
popularizers - people who use research as part of their work in writing and speaking with 
educators and the public. There is a large industry in education in the area of professional 
development, much (though certainly not all) of which is informed by current research. 
Politicians and officials often learn about research from lobbyists and interest groups who 
use it to advance their political views. A variety of other bodies - think tanks, foundations, 
professional organizations — are also involved in research dissemination. Another important 
role can be played by “policy entrepreneurs” (Mintrom, 2000) - people who set out to 
advance a particular cause and use research as part of that cmsade. Of course all these 
parties have their own reasons for being interested in research, which are not necessarily 
benign. 

Although third parties use research for a range of reasons, these mechanisms are the 
main way in which new ideas from research penetrate existing policy and practice. But these 
ideas are also filtered by users of through their own interests and beliefs. Each field of 
human activity - education, health, justice, and so on - has its own set of practices, habits 
and accepted wisdom. People who work or live in one of these worlds do not tend to see 
themselves as deficient even though they may recognize areas where they do not know how 
to meet a challenge or achieve a goal. Teachers are immersed in the work of teaching, or 
bureaucrats in managing government programs, work that they feel they understand and 
know how to do, even if imperfectly. Research affects their practice only as they become 
convinced that the ideas or practices suggested will actually improve their work or their lives 
in some way (Cordingley, 2000; DETYA 2000). A considerable body of research on change 
and innovation (e.g. Fullan, 2001; Rogers, 1995) helps us understand the complexities of 
these processes. 

Once this dynamic is recognized, several other points follow. The most important is 
that the use of research is embedded in a set of personal and organizational beliefs and 
practices that are complicated and often deeply entrenched. These can include personal as 
well as organizational goals; the standards, policies and culture of the organization or 
occupation; the practical tasks that confront people every day; and of course personal 
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predispositions and beliefs, affected as these are by people’s biographies, personal as well as 
occupational. 

From this perspective we can see why it is so hard to change people’s behaviour and 
organizational practices. The power of the forces of stability is why we have so many 
examples of changes that seemed completely obvious being resisted for long periods of time, 
such as giving fresh fruit and vegetables to sailors on long voyages to prevent scurvy or 
washing hands in medical care to prevent infection, or wearing seatbelts as a way of reducing 
deaths and injuries in automobile accidents. The same forces apply to individuals. Knowing 
that seat belts save lives or that smoking is a health hazard has an effect on behaviour but 
not immediately and not for everyone. 

In the public arena - the world of governments and most large organizations - yet 
another set of constraints on change arises from political processes (Levin, 2001). 
Organizations that are in the public eye - governments, of course, but also many other large 
organizations - are inevitably sensitive not only to the views of their internal participants but 
also to larger political currents. One of the rules of the political world is that what is true is 
far less important than what most people believe to be tme. A government may be in a 
position where it is caught between what it believes is the best course of action and what it 
believes is publicly acceptable. In a world where public acceptance is the key to survival it is 
easy to predict which interest will dominate. It is only when public beliefs shift that 
governments will feel required or able to move. 

In addition to sector structures, the larger social and intellectual context of society is 
also important. What gets accepted as knowledge is influenced by a larger climate of ideas 
and conventional wisdom. The growing interest in research and evidence described earlier 
can also be seen as part of this larger context. For example, if one accepts the idea of 
increasing uncertainty and reflectivity in society (e.g. Giddens, 1994), one might see an 
interest in research as part of a larger search for new sources of truth to compensate for the 
decline of religious belief or the decline in confidence in most of our institutions (Stone, 
1997). There could then be a danger that what is presented as scientific gets uncritical 
acceptance, a possibility that carries its own risks (Willinsky, 2003). These issues are much 
larger than can be dealt with here, but their importance needs to be acknowledged. 

The point is that the role of research and evidence in any setting will inevitably be 
mediated by other pressures and demands as well as by existing habits, practices and 
cultures. Research alone will not overcome strongly held biases about race or gender. It will 
not unilaterally convince people to change long-standing power relationships. However, 
with care and over time it can play an important role in changing what people think and 
what they do. People, policies and practices do change in response to a variety of influences. 

Recognizing the social and political dimension of research impact and the 
importance of mediating mechanisms opens new possibilities, for it suggests that research 
impact can happen precisely through these same social and political forces. Seeing research 
impact in this longer-term and more diffuse way raises possibilities for building bridges 
between research (and researchers) and other social processes. 
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A Model of Impact 

Growing out of the discussion so far, I suggest that research impact should be seen 
as having three elements: 

1) The context of research production, including what research gets done, who does it, 
how it is done, what communication activities are undertaken, and so on. Research 
production is largely located in universities but also takes place in a variety of other 
organizations. 

2) The context of research use, including those settings that have an interest in the 
application of research. This context includes governments, educational 
organizations of all kinds, teachers of all kinds, and also parents, students and a 
variety of other community groups with an interest in education. Of interest here 
are the views, capacities and structures through which such organizations are able - 
or limited in their ability - to find, understand and use research. 

3) The connections and interactions between the two other contexts, involving all kinds 
of direct and mediated, face to face, print, electronic and other vehicles, formal and 
informal. These are the strands of connection - some strong, others quite weak - 
between the two other contexts through which enhanced impact must come over 
time. While some connections are directly between researchers and users, most of 
the connection happens through third party mediation. The connections also run to 
varying degrees in both directions; that is, research production and mediation are 
also influenced by contexts of use. 

These elements are illustrated in Figure 1, which is less a model than an attempt to 
represent some of the factors and linkages related to research impact. As suggested in the 
figure, the contexts of use and of mediation are larger in size than the research production 
effort, and the whole enterprise is situated in a larger social context that is itself constantly 
changing. The diagram should also remind us that the actions of researchers, while 
important, are only one part of the effort to affect ideas and social practices. 

The diagram also may overstate the degree of separation between the context of 
production and the context of use. In fact, many people and organizations work in both 
contexts. Individuals may move back and forth between research posts and educational 
practice (keeping in mind that most university faculty are also teaching practitioners). 
Practitioners who are also graduate students provide an important potential bridge (DETYA 
2000). Organizations may be involved in research production as well as its use. 

At the same time, the term “contexts” suggests that it is the task and setting more 
than the person that affects how the work is done. Researchers who move to practice may 
not themselves be great users of research in their new roles because their new organization 
does not provide the means or lacks capacity to use the results. The parts of organizations 
that generate research may find themselves at odds or out of sync with the units that are 
more directly involved in policy because the research is not of just the right kind at just the 
right moment. 
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In seeking to improve the impact of research, attention is required to all three 
elements, and each must be understood on its own terms, not treated as deficient based on 
criteria that apply somewhere else. The goal cannot be to turn researchers into practitioners 
or vice versa. In other words, our stance cannot be one that starts with the view that if 
someone else were more like us, problems would be solved. 

The State of Research Impact in Education 

It is risky to summarize developments in this area across countries that differ greatly 
in many respects. Nonetheless, based on looking at developments in the United States, 
Canada, and Britain, as well as work by the OECD, a few generalizations do seem justifiable. 

Insufficient research often narrowly conceived 

The education research enterprise around the world is small. The OECD concluded 
a few years ago that the effort in research in education in all countries was typically well 
under 1% of education expenditures - a low investment relative to other knowledge- 
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intensive sectors, especially health (OECD, 2002a). The U. S. has the largest education 
research effort in the world, but it is still very small in comparison with the size of education 
as a sector or in comparison with research in health or science (Shavelson & Towne, 2002). 
Willinsky (2000) noted that the workforce in four-year colleges in the United States is larger 
than that in steel, auto and textiles combined, yet the research investment in improving the 
latter is far greater than in the former. 

The production of research on education in most countries takes place mainly in 
universities. The largest portion of research is driven by the interests of academics, primarily 
in faculties of education but also in various other social sciences (such as sociology or 
economics) and occasionally in other applied fields such as management or various 
professions. Processes for linking research agendas to the needs and interests of practice 
and policy are often weak. 

The bulk of the funding for university research comes from the internal resources of 
universities or from external funding agencies. A small number of research universities tend 
to dominate the enterprise. Coverage of various areas of education is quite uneven. Taken- 
for-granted ideas about appropriate topics or methods may make it difficult for some issues 
to get any attention or support. Depending on the number and interests of the researchers, 
some areas get a reasonable amount of attention while others receive very little. In other 
cases, the interests and work of university researchers may be shaped to a considerable 
extent by the ways in which funding is made available, so that a substantial amount of 
funded research may end up being directed to the issues that funders - typically 
governments - want to have investigated. Most university researchers in education are 
concerned with elementary and secondary schools, while early childhood, post-secondary 
education and adult education get much less attention. 

Most education research is short-term and small-scale, although increased funding of 
research networks and centres in several countries in the last few years has helped develop 
better connections among researchers and longer-term approaches. There is a general view 
that research methods in education have gradually shifted towards small-scale qualitative 
work and that there are not enough researchers with good skills in working with large data 
sets even as the number and quality of such data sets is increasing. 

University-based research is driven by the university culture and reward system; it is 
primarily aimed at communication with other scholars and the rewards are related to 
research grants and peer recognition, although connections with and recognition by the 
broader education community also play a role. Schools of education suffer from low status 
within the university and in the broader community (Lagemann, 2000; Labaree, 2003). The 
more influential institutions tend to dominate not only what work gets done, but what work 
gets noticed. 

Another component of the research enterprise takes place in governments and non- 
governmental agencies. Although most educational practice in the United States and Canada 
is directed by states, provinces, and local authorities, few of these bodies invest any 
significant funding in research beyond work done to meet current policy-making needs. 

Only the larger school districts maintain research operations, primarily in support of 
operational needs. In all countries, national non-governmental organizations tend to have 
very modest resources for research. 

Some research in education is conducted by various third party organizations such as 
national organizations, interest groups, think tanks, and, occasionally, other organizations 
such as the Conference Board or labour groups. With the increase of interest in training and 
lifelong learning, a variety of business organizations, such as sector councils, have also 
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involved themselves in some kinds of applied research. In some settings, private companies 
and consultants are involved in education research, largely when contracted by government. 
Still, the overall research effort by these bodies is both small and inconsistent, and is not 
always well linked to the larger process of knowledge development. 

In sum, the education research enterprise tends to be modest, narrow and often 
fragmented, though with pockets of strength. 

Limited capacity to use research 

Most of the attention in the literature on research impact focuses on the research 
production side. However, even the best, most effectively shared research will not matter 
unless users are willing and able to benefit from it. The capacity of users is therefore a vital 
but largely uninvestigated issue (Lavis et al., 2003). 

The potential range of people and organizations interested in research in education is 
enormous. Governments are key given their responsibility for the education system. 
Potential users also include all those - teachers, students, administrators, policy-makers - 
who are directly involved with early childhood education, schools, college, universities, 
private providers, adult education and workplace learning. Beyond that, almost every group 
in society - parents, employers, workers and their organizations, and the non-profit sector - 
has an interest in education in one way or another and thus a potential connection with 
research. The sectors of education vary gready in their size and organization. So do user 
organizations, which range from huge educational enterprises or employers to single schools, 
small businesses, and, of course, individual students and parents. 

The picture arising from the limited evidence available is that although a wide variety 
of organizations are interested in the results of research, very few organizations have the 
capacity to be involved actively in research partnerships or to make extensive use of the 
results. Efforts to increase teacher research or action research mn into problems of time 
and research background among teachers. Many user organizations - for example, schools, 
adult learning organizations, or individual employers - are small and lack any staff with 
training or skill in research. In the less organized sectors, especially adult learning, there are 
simply fewer organizations of any kind to be involved. Even among more substantial 
organizations, few appear to have organized processes for learning about and making use of 
current research even when it is directly relevant; rather they often rely on whatever time and 
effort individual staff members may make or on what happens to cross their desks. 

The lack of capacity among users means that demand for education research results 
is low relative to other fields (Shavelson & Towne, 2002). Educators tend to rely on 
research results as reported by the media or by third parties of various kinds. A great deal of 
third party research or interpretation is driven by other agendas, whether of particular 
foundations or interest groups, or sometimes of individual “policy entrepreneurs” (Mintrom, 
2000) who are promoting their own ideas. The interplay of ideas through political processes 
is an important part of democratic governance (Lindblom, 1990). However one result of 
multiple voices is that user organizations do not know what sources to turn to, what sources 
to tmst, or how to identify high quality work, leading to the view that “you can prove 
anything with research.” 

Many organizations also have limited or no ability to share research results effectively 
within their organization. Again, how much sharing of knowledge occurs often depends on 
the initiative of individual staff members. Organizations are reluctant to get involved in 




Education Policy Analysis Archives Vol. 1 2 No. 56 


11 


research partnerships because of the demands that may be placed on their resources and the 
uncertainty of potential benefits. For all user organizations, research is only one part, and 
often a small part, of their work. So, while interest is high and intentions are good, capacity 
is quite limited and performance is often weak. Whatever improvements may be made in 
the production of research, improving the impact of research will also require significant 
attention to strengthening the capacity of users and their organizations. 

Inadequate linkages 

Efforts are being made to connect research with policy and practice, but most are 
small scale. Researchers are broadening their dissemination efforts somewhat — for example 
by more extensive use of websites. Some newer forms of research, such as action research 
or teacher research, build in partnerships and a focus on use. Some research funding 
programs emphasize research impact, leading to a range of strategies such as workshops, 
publications, briefings, and in some cases staff positions focused largely or wholly on 
knowledge transfer. However, most dissemination plans for academic research remain quite 
limited and traditional, especially if one accepts the view outlined earlier of research as an 
element of public debate and political practice. 

A number of national organizations are involved in one way or another in supporting 
research impact. Bodies such as the national membership organizations (e.g., teachers, 
school boards, administrators) do try to disseminate research in print and especially on the 
web. The same is true of third parties such as think tanks and interest groups. Some efforts 
have also been made in other countries to replicate the success of the ERIC system in the 
United States as a reasonably comprehensive index of education research; but as the ERIC 
experience shows, this is a difficult and resource-intensive activity. 

A variety of other outreach mechanisms have also been tried, such as research 
programs focused on strategic issues, support for interdisciplinary work, support for 
dissemination-focused activities such as conferences and publications, and the creation of 
research networks that involve partners from outside the research community. Particular 
mention needs to be made of the importance of the internet as a research communication 
vehicle. Some very interesting efforts are being made to use the internet in ways that focus 
specifically on providing research information more effectively and on moving beyond 
passive web sites to building interaction (e.g. Willinsky, 2000, 2003; http:/ /pkp.ubc.ca). 

Despite these efforts, linkages are relatively weak. The models of dissemination and 
impact remain quite cautious. Few efforts are based on an articulated theory of how impact 
occurs with the result that there is still too much reliance on a direct transmission model of 
impact. Insufficient attention has been paid to the capacity of users and to the critical role 
of third parties, including the media, in creating research impact. Connections between 
researchers and potential users remain largely a matter of happenstance, depending often on 
personal ties that already happen to be in place. Work in health and social policy by Lavis et 
al. (2002) and in social policy by Landry et al. (2001) show that even applied research 
organizations employ only a limited range of strategies for increasing the impact of their 
work. 
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Noteworthy national developments 

England 

The Department for Education and Skills launched an English education research 
strategy several years ago. The strategy has several main elements. One development has 
been funding of the EPPI (Evidence-Informed Policy and Practice) Centre at the University 
of London (eppi.ioe.ac.uk). EPPI is involved in doing syntheses of research in selected areas 
with a strong focus on implications for practice including involvement of users in choosing 
topics for synthesis, participating in the reviews, and preparing reports aimed at particular 
audiences such as teachers or school governors. 

The government has also committed to doing more evaluations of its policies with 
the results being made public (e.g. Earl et al., 2003). Research occupies a prominent place 
on the DfES website (www.standards.dfes.gov.uk) and in its policy documents. Research 
centres have been created in key areas such as “the wider benefits of learning” or 
“economics of education.” The National Education Research Forum (NERF - www.nerf- 
uk.org) is a vehicle for broad discussion of research issues and is linked to some other 
creations, such as the Teacher Research Panel and the Teaching and Learning Research 
Program (www.tlrp.org) funded to promote quality research on teachers and teaching while 
also increasing the capacity of educators to find and use relevant research. Other activities 
include a Research Capacity Building Network (www.cardiff.ac.uk/ socsi/ capacity) and a 
program to have teachers and journalists rewrite and summarise “learned journal” articles 
which are then made available freely through a website. 

Canada 

The Social Sciences and Humanities Research Council of Canada (SSHRC) recently 
launched a new research initiative on “The New Economy” that provides substantial 
additional research funding for education with a strong emphasis on impact. This initiative 
comes amidst concerns that Canadian capacity in education research generally is weak. 
SSHRC is also proposing to transform itself from a granting council to a “knowledge 
council” focusing not just on supporting research but on supporting its use. In support of 
this aim the Council has increased funding for dissemination within research projects and 
has developed a number of vehicles to build research capacity and impact in areas of 
strategic importance, including funding that is contingent on meaningful partnerships with 
potential users of research from the outset. Although education in Canada remains a 
closely-guarded area of provincial responsibility, there have been some good examples of 
federal-provincial-third party collaboration in building the value and impact of education 
research, such as the Pan-Canadian Education Research Agenda (www.cmec.ca/ stats/pcera) 
and the Canadian Education Statistics Council. Human Resources Development Canada, a 
large federal department, has supported the development of several national longitudinal 
studies. In 2002 the federal government also announced its intention to create the Canadian 
Learning Institute to provide a forum for increased collection, analysis and sharing of 
evidence and research on learning. 

United States 

The Bush administration has adopted a particular view of education research with a 
stress on what is called “science-based” work and an emphasis on using randomised 
controlled trials (RCT) as the main vehicle in research. The Office for Educational Research 
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and Improvement (OERI) has been renamed, under the Education Sciences Reform Act of 
2002, as the Institute for Educational Science and has advocated a research approach based 
on randomised controlled trials (Coalition, 2002). The Department of Education is 
participating actively in the Campbell Collaboration (www.campbellcollaboration.org) and is 
also creating a clearinghouse of “what works” information (www.w-w-c.org). The 
government has also recently proposed cutbacks to the ERIC system including the removal 
of many studies and journals from the index on grounds of low quality. The Department’s 
stance has been controversial, with many researchers regarding it as too narrow and as 
primarily motivated by political considerations. 

In light of these debates and controversies, in 2002 the U. S. National Research 
Council produced a report on “Scientific Research in Education” (Shavelson & Towne, 
2002) that tried to provide a balanced approach in assessing quality and increasing impact. 
The report identified a set of principles that should inform high quality research and laid out 
ways in which government could support this direction. However the role and nature of 
research remains a politically controversial issue in the U S to an extent not matched in other 
countries, and the immediate future of education research remains uncertain. 

Despite these debates, the U S system has some longstanding practices and 
organizations devoted to research impact. The ERIC system has for many years, in addition 
to providing access to research, commissioned reviews of research and prepared a variety of 
print and electronic vehicles for making these reviews widely available (although the 
government now intends to eliminate this latter role). A number of large research centres, 
such as the Center for Policy Research in Education (CPRE) and the Learning Research and 
Development Center (LRDC) have been funded by the federal government in key policy 
areas for many years, and these centres have research impact as an important part of their 
mandate. While it is difficult to know just how much impact these efforts have had, they are 
surely linked to the growing awareness of research among educators (Biddle & Saha, 2002). 
However many of the centres remain primarily organizations of researchers rather than true 
partnerships with users. 

National agencies such as the Council of Chief State School Officers, the ASCD, the 
National Governors Association and others have been involved with efforts to strengthen 
the impact of research in education. The Spencer Foundation has recently commissioned a 
series of articles on research for Education Week in an attempt to support a wide and 
thoughtful debate. AERA has also become increasingly active in the area of research 
impact., though the AERA debates on how to move in this direction also illustrate the 
difficulty of doing so in a way that is acceptable to a large and diverse membership with quite 
varied political views. 


Possibilities for Action 

Efforts to strengthen the impact and value of research in education need to pay 
attention to all three contexts - production, use, and the linkages between them. We should 
also see research impact as itself a subject about which we need to learn more. In the next 
sections, some useful but modest actions are outlined under each of these headings. Most of 
these suggestions have been made before in one place or another, but few recommendations 
that I have seen begin with a view of the entire process of research impact as interactive. 

The suggestions are not aimed only at researchers, but also at research funders, users, 
governments and third party organizations, since researchers alone cannot do what is 
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needed. They are intended to be practical yet also meaningful, and they could apply to a 
wide range of kinds of research. 

Improving research production 

The goal of the proposals in this section is to increase the attention researchers pay 
to impact. Researchers alone cannot ensure the effective use of research, but they do play an 
important role. Nor am I arguing that research should only be supported if it has 
practitioner support or direct implications for practice. For many reasons, not least the 
unpredictability of what will turn out to be valuable knowledge, an important role must 
remain for research that is driven purely by researcher interest. However even in interest- 
driven research not intended for any immediate application there could well be benefits to 
researchers thinking about who else might be interested in their work and how that interest 
could best be encouraged. 

1.1 Give greater attention to impact in research granting processes. Build impact into the 
criteria for evaluating grants, require researchers to include previous impact work as part of 
their application, and foster careful consideration of impact strategies in peer review 
committees. 

1.2 Provide supports and resources to researchers to assist research impact. For example, 
providing a checklist of possible strategies for impact might encourage researchers to pay 
more attention to this element of their work. 

1.3 Support universities in building the same kind of effort in knowledge mobilization in 
education as they have in the sciences and engineering. While the processes are not 
identical, technology transfer offices, whose task it is to help researchers with the application 
of their work and to negotiate relationships between researchers and users, provide a model 
that could be applied in education also. 

1.4 Strengthen the input of potential users in the development and review of research 
proposals. There are many cases where some early discussion between researchers and users 
would result in stronger studies as well as enhanced interest by potential users. 

1.5 Take steps to extract maximum value from existing research. Often researchers get busy 
with the next project before they have fully exploited the potential of the last one. To 
improve this situation one need is to make data more available to other researchers who 
might want to use it again. A second step is to encourage researchers to spend more time on 
exploiting their data instead of immediately going on to a new grant and a new study. 

Finally, strengthening international research links is important to ensure the utility of 
relevant work wherever it is done. 

1.6 Build networks of researchers and users with common interests as a way of developing 
larger-scale programs of research with stronger links to use. Networks can be important in 
increasing attention to knowledge mobilization and in building stronger, more coherent 
research programs. More work could be done to link researchers with common interests 
even where they are not part of a formal network with independent funding. 
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Improving use 

Research will not have impact unless potential users are interested enough to look 
for it and able to make use of what they find. It is vital to develop the capacity of users to 
find, understand and use research. However because relatively little is known about how to 
do this, first steps will require learning more about the limits of the current situation and 
strategies that might be effective. 

2.1 Work with major user organizations in education and beyond to learn more about their 
capacities and limitations. This kind of analysis could itself be a useful step in generating 
increased capacity. For example, how do school districts currently find and distribute 
relevant research? How could their efforts be better supported? 

2.2 Work with user organizations that want to be more active in making use of education 
research. Examples include the creation of user networks, further analysis of effective 
internet-based knowledge exchange practices, learning more about what internal 
communication practices are most effective, or increasing the number of organizations 
employing staff with good backgrounds in research. 

2.3 Develop better means of exchange of information among user organizations. Examples 
include shared processes of literature scanning, better means of exchanging information on 
relevant research, or the creation of networks of staff in different organizations who have 
research impact responsibilities. 

2.4 Support placement of researchers and graduate students in user organizations. 
Opportunities for placement of people with good research skills in user organizations, such 
as internships for graduate students, could help build ongoing capacity in those 
organizations. 

Linkages between production and use 

A number of steps can be taken to broaden and deepen connections between 
researchers and users. Among the most interesting possibilities are: 

3.1 Employ people who are skilled in “translating” research results into plain language for 
distribution to non-specialist audiences. Such specialists - people who can write 500 word 
op-ed pieces or brief summaries for distribution to policy-makers - could be employed by 
universities or might be directly sponsored by funders. 

3.2 Use media relations experts to build media connections. Despite the importance of the 
media, few researchers have any experience in attracting media attention or communicating 
in a way that preserves the essence of their message. Again, these resources could be 
available through universities or through other bodies. 

3.3 Make better use of existing venues for effective exchange between researchers and users. 
Face to face contact remains vital in building tmst and interest. Almost everyone in 
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education already participates in various events that could have a research component to 
them yet do not. Sponsoring more opportunities for researchers to participate in user events 
and for users to attend and participate meaningfully in research events would help build 
ongoing links. 

3.4 Increase the connection between research and professional development in user 
organizations. Professional development is a key means of bringing research to practice 
(Cordingley, 2000, Figgiss et al., 2000). Steps could be taken to make it more likely that 
effective interaction occurs by working with associations or other networks that organize 
professional development work in various sectors. 

3.5 Learn more about effective web interaction around research. Many web-based efforts to 
disseminate research already exist, including those supported by researchers and those 
supported by user organizations. It is important to understand what practices work most 
effectively, and especially how it might be possible to move beyond passive information 
provision to more interactive forms of engagement on the web. 

3.6 Reconsider effective print and electronic vehicles such as books, CDs, journals, 
magazines, newsletters, and brochures. Print remains a key means of distributing 
information but publication practices are rapidly changing largely due to developments in 
information technology. Often published work takes a long time to appear and is even then 
not readily accessible to users. New approaches to publication and distribution need 
investigation. 

3.7 Expand literature reviews, research syntheses, and the drawing of “what works” or “what 
we know” conclusions. Single studies are rarely powerful impacts on practice, nor, given 
their limitations, should they be. Users are interested in conclusions drawn from substantial 
bodies of research. Yet few researchers are involved extensively in this kind of work. More 
discussion and action are needed on how to develop effective syntheses or to participate in 
wider synthesis networks. Some of the developments in England mentioned earlier merit 
wider attention. 

Learning about research impact 

Our current situation is that although there is interest, we do not yet know very 
much about this whole area and therefore need to learn as we go. In many areas it will be as 
important to study our actions carefully as to take the steps in the first place. It will also be 
important to organize some selected learning events, web networks and other activities that 
focus on research impact itself. Connections need to be built with other social policy fields 
that are engaged in similar efforts such as health and justice. 

Conclusion 

Research is only one part of the way our societies make decisions about policy and 
practice. Other social and political forces will usually be more important and researchers will 
often feel that their work is ignored or misused. Nonetheless, growing interest in research 
and its potential contribution to policy and practice in education are heartening 
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developments. While risks exist, and the results are unlikely ever to be as good as 
researchers might wish, there are steps that could be taken by all parties with an interest in 
education to strengthen the contribution of research to policy and practice in education. 

Note 

This article was supported by a research grant from the Social Sciences and Humanities 
Research Council of Canada (SSHRC) while I was visiting scholar there in 2002-03. I thank 
Marc Renaud, President of SSHRC, for the opportunity to think about these issues. 
Colleagues too numerous to list at SSHRC and in the broader education research community 
have helped my thinking, and comments by the various reviewers were also very useful. All 
interpretations and any errors are solely my responsibility. Nothing in this paper should be 
taken to represent the policy or opinion of SSHRC or any other organization. 
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